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Abstract. Let p be a prime and let r, e, m be positive integers such that 
r\e and e\m. The enumeration of Unear codes of length p" 
are invariant under the affine linear group AGL(- 
enumeration of certain ideals in a partially ordered set {U, -<) where U = 
{0, 1, • ■ ■ , — (p — l)}'' and -< is defined by an e-dimensional simplicial cone. 
When e = 2, the enumeration problem was solved in an earlier paper. In 
the present paper, we consider the cases e = 3. We describe methods for 
enumerating all AGL(-^, F^a )-invariant linear codes of length over Fpi- 



1. Introduction 

Extended cyclic codes which are invariant under a certain afRne hnear group 
were first studied by Kasami, Lin and Peterson [9] and by Delsarte [7]. These codes 
were further investigated by Charpin [4] [5], by Berger [1], Berger and Charpin 
[2] [Sj in the context of permutation groups, and by Charpin and Levy-Dit-Vehel 
[B] in conjunction with self-duahty. Extended cycUcity follows from afhne invari- 
ance except when the code is the full ambient space; see later in the introduction. 
AfRne-invariant codes are interesting because of the large automorphism groups 
they possess. Examples of afhne-invariant codes include the g-ary Reed-MuUer 
codes which are precisely AGL(m, Fg)-invariant codes of length over F^. 

The interest of afhne-invariant codes is not limited to coding theory. As we 
will see below, such codes are precisely submodule of a certain module over the 
group algebra K[AGL(n,F)] where F and IK are two finite fields of the same char- 
acteristic. Therefore, affine-invariant codes provide concrete examples of modular 
representations of the affine linear group AGL(n,F). 

The present paper and its predecessor ^8^ deal with the enumeration of affine- 
invariant codes. Delsarte's characterization of affine-invariant extended cyclic codes 
in terms of defining sets [7j is the foundation of our work. The starting point 
of our approach is a reformulation (Theorem II. ip of Delsarte's characterization; 
the reformulation changes the enumeration problem from an algebraic one to a 
combinatorial and geometric one. 

A comprehensive introduction to affine-invariant extended cyclic codes can be 
found in [2] . A detailed introduction to our approach was given in [8] . Thus in the 
present introduction, we only give the essential facts to be used in the paper. 

Let p be a prime and r, m, e positive integers such that e|m. Identify Fpm with 
¥™J'^. Then the affine linear group AGL(^,Fpc) acts on F^™ hence also acts on 
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the group algebra Fpr[(Fpm, +)]. Put 



Gn 



AGL(- 



Then Fp. [{¥pm , +)] is an Fp. [G„,e]-niodule. Define 
M = {J2 agX^'eFp,.[(Fp™, +)] 



^ «9 = 



^-invariant codes over F„ 



Fpr [G„i_e]-submodules of Fpr [(Fpm , +)] are Gm,e- invariant codes over Fpr ; Fpr [Gm.e]- 
submodules of M are Gra,e- invariant extended cyclic codes over Fpr. In fact, every 
proper Fpr [Gm,e]-submodules of Fpr [(Fpm, +)] must be contained in M ( 8 ). 

As pointed out in [5], in order to determine Fpr [Gm,e]-submodules of M for all 
r, it suffices to determine those with r\e. Thus we always assume r|e. 

Let 



P 



p" 



P 



e-2 



P 
P' 



p" 



be 



For u,v G M.^ , we say u ^ v ii {u — v)P has all the coordinates < 0. Let A C 
the set of all linear combinations of the rows of 



il-plP-' 



with nonnegative coefficients. Namely, A is the e-dimensional simplicial cone 
spanned by the rows of (1 — p'^)P^^. It is clear that u ^ v if and only if w G u + A. 
The relation -< is a partial order in R"^. 



1 





•■ 


• 


-p 


~p 


1 


•• 


• 








-p 


1 ■ • 


• 











•• 


1 











•■ 


■ -p 


1 



Let 



A = 





1 
1 



1' 





1 

be the circulant permutation matrix. Since AP — PA, the matrix A preserves the 
partial order i.e., u -< u if and only if uA -< vA. 

For any subset fl C Mf-, {fl, ^) is a partially ordered set. An ideal of {fl, ^) is a 
subset / C f2 such that for each u E I and i; e fi, w -< u implies v € I. 

Let 



For each s £ {0, 1, 



iY={0,l,-.-,^(p-l)}' 
— 1}, write 



So/ + • • • + s^-ip" \ 0<Si<p~l, 
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and define 

cr(s) = [ ^ Si, ^ Si, ^ Si eU. 

i=0 (mod e) z=l (mod e) i^e— 1 (mod e) 

The following is a reformulation of Delsarte's characterization of affine-invariant 
extended cyclic codes [7]: 

Theorem 1.1. ([5]) There is a one-to-one correspondence between the ¥pr[Gm,e]- 
submodules of¥pr[(¥pm, +)] and the -invariant ideals of (U, ~<). If I is an A^- 
invariant ideal of {hi, -<), the corresponding ¥pr[Gm,e]-submodules of¥pr-[(¥pm, +)] 
is 

M{I) :={ a,XS e ¥p.[i¥p^, +)] : ^ a^g^ = 

for all s e {0, 1, • • ■ - 1} with a{s) E /|. 

In (jl.ip . 0° is defined as 1. Moreover, M{I) E M if and only if I ^(1). 

Note. When e = m, i.e., when = {0, 1, . . . ,p — 1}*^, the partial order -< in W is 
the cartesian product of linear orders. Namely, {xi, . . . , Xe) ~< {yi, . . . , ye) in U if 
and only if Xi < yt for all 1 < i < e. However, this is not the case when 1 < e < m. 

Example 1.2. Let p = 3, m = 6, e — 3, r — 1 and 

{(0,0,0), (1,0,0), (0,1,0), (0,0,1), 

(0,1,1), (1,0,1), (1,1,0), (1,1,1), 

(2,0,0), (0,2,0), (0,0,2), 

(3,0,0), (0,3,0), (0,0,3)}. 



y 



■3 




Figure 1. The ^-invariant ideal / 
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It is easy to see that / is an A- invariant ideal of {U, ^). We have 

a-\l) = {0, 1, 2, 3, 4, 6, 9, 10, 12, 13, 18, 27, 28, 29, 30, 36, 39, 54, 
55, 81, 82, 84, 87, 90, 91, 108, 117, 162, 165, 243, 244, 
246, 247, 252, 261, 270, 273, 324, 325, 351, 486, 495}. 

The F3[G6.3]-submodule of A4 corresponding to / is 

M{I) = {Y. "9^" ^ 1F3[(F36, +)] : Y. "'99' = for aU s E 

Therefore, the essential problem is how to enumerate the ^4 '"-invariant ideals of 
{U, -<). When e = 1, the problem is trivial. When e = 2, the problem has been 
solved in [8]. The present paper deals with the case e = 3. We will describe methods 
for enumerating all ^''-invariant ideals of (U, ^) for e = 3. 

2. Description of the Approach 

For simplicity, an ideal of {fl, where C M*^, is called an ideal of fi. 

Lemma 2.1. (i) Let C F C K."^ such that fl and F are -invariant. If I is 
an -invariant ideal of il, then there is an -invariant ideal J of T such that 

jnn = i. 

(ii) Let Q a W and T a W . Let I be an ideal of Q and J an ideal of F such 
that / n F = J nQ. Then I U J is an ideal of QUT if and only if 

(2.1) (/ + A)nFcJ and ( J + A) n 17 C /. 

Proof, (i) Let J = (/ + A) n F. Then J is an ^''-invariant ideal of F. Since / is an 
ideal of fl, we have J n = (/ + A) n = /. 

(ii) (=>) Since (/ + A) n (il U F) is the ideal of U F generated by /, i.e., the 
smallest ideal of U F containing /, and since / U J is an ideal of U F, we have 
(/ + A) n (f7 U F) C / U J. Hence 

(/ + A) n F = (/ + A) n (17 u F) n F 
c (/ u J) n F 
= (/ n F) u J 
= (Jnr?) u J 
= J. 

In the same way, ( J + A) n c /. 
(<S=) We have 

(/ + A) n (17 u F) = [(/ + A) n 17] u [(/ + A) n F] c / u J 

since (/ + A) n li = / and, by (EH), (/ + A) n F C J. In the same way, ( J + A) n 
(17 U F) C / U J. Therefore, 

[(/ U J) + A] n (17 U F) C / U J, 

which makes / U J an ideal of 17 U F. □ 

In general, all ^''-invariant ideals of U can be constructed using the following 
inductive strategy. Partition U into ^""-invariant subsets Ui, . . . ,Uk. Let 1 < i < fc 
and assume that for each j with j < i, an ^''-invariant ideal Ij of Uj has been 
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constructed such that Uj<i -^j ideal of Uj<i^i- Construct an ^'"-invariant 

ideal of Ui such that for all j < i, 

(2.2) (/, + A) n Uj C Ij and {Ij + A) n C h. 

Then by Lemma [2.11 (ii), ljj<i^j v4''-invariant ideal of IJjXi^i- Eventually, 

/ = Uj<A: is s-i^ ^""-invariant ideal of U with I nUi ~ Ii for all 1 < i < fc. We 
shall call an ideal Ii of satisfying (|2.2p compatible with /j (j < i). 

Remarks, (i) Constructing an ^''-invariant ideal / in is an e-dimensional geo- 
metric problem. By partitioning U suitably, constructing an ^''-invariant ideal Ii 
in Ui becomes an (e — l)-dimensional geometric problem. 

(ii) Since for each ^''-invariant ideal I oiU, I C\Ui (1 < « < fc) is ^''-invariant 
ideal olUi, the above strategy does enumerate all ^''-invariant ideals of U. 

(iii) The existence of an ^''-invariant ideal It of Ui compatible with Ij [j < i) 
is guaranteed by Lemma 12.11 Hence the inductive construction can always be 
completed. 

To turn the above strategy into an enumeration algorithm, what we essentially 
need are effective methods for enumerating all ^''-invariant ideals Ii which are 
compatible with an existing sequence of ^''-invariant ideals /_,- (j < i). The main 
purpose of this paper is to provide such effective methods in the case e = 3. 

Form now on, we assume e = 3. Put 

TO 

n= —{p-l). 

Since r|e, there are two possibilities for r: r = 1 or 3. When r = 3, we partition U 

as 

n 

(2.3) U^\JU, 

i=Q 

where 

Ui ^ {{x,y,z) eU : z = i}. 
When r = 1, we partition U as 

n 

(2.4) W = U V. 
where 

Vi — {{x,y, z) € U : X < i, y < i, z < i, and at least one oi x,y, z is . 

Section 4 deals with the case r = 3. We describe two methods for enumerating 
compatible ideals Ii of Ui. The method of forward slicing enumerates all ideals Ii 
of Ui which are compatible with ideals Ij of Uj where < j < i; the method of 
backward slicing enumerates all ideals Ii of Ui which are compatible with ideals Ij 
of Uj where i < j < n. Section 5 deals with the case r = 1. We describe a method 
for enumerating all A-invariant ideals Ii of Vi compatible with A-invariant ideals 
Ij of Vj where < j < i. In preparation for these attempts, in the next section, 
we first take a close look of the cross section of an ideal in W on a plane parallel to 
a coordinate plane. We also introduce the notion of walk in the next section. 
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3. Cross Sections and Walks 

Let c G M. Observe that A n (M^ x {c}) consists of points (x, y, c) G R'^ satisfying 

X + py + p^c < 0, 
p^x + y + pc < 0, 
px + p^y + c < 0, 



(3.1) 



x+py < min{-p2c, -|c}, 



I p X + y < —pc. 



The solution set of ()3.1|) is depicted in Figure 2 when c > and in Figure 3 when 
c < 0. 




Figure 2. The cross section of A on the plane z — c, c > 





Figure 3. 



The cross section of A on the plane z — 



c, c < 
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V 




Figure 4. The region D 



Let 

D = {{x,y) : X + py < 0, p^x + y < O} 
(Figure 4). We can write 



(3.2) 



A n (R^ X {c}) = 



_{{D~c{0,p))x{c\, ifc>0, 



(i?-c(i,0)) X {c}, ifc<0. 



Given {xi,yi,zi) and (x2, 2/2,22) in M'"', (a;i,j/i,zi) ^ (2:2, 2/2, 2^2) if and only if 



(a;i,2/i) e (0:^2,2/2) + 



{zi — 22})- By (|3.2|) . this happens if and only 

-D ~ (Zl - Z2)(0,p), if Zi > Z2, 
L> - (Zi - Z2)(i 0), ifzi<Z2. 



(a;i,yi,zi) - (0:2,2/2,22) € An 
if 

(3.3) 
Thus 

[(a^2,y2,22) + A] n [r2 X {zi}] 

(3-4) ^ ('[(x2,2/2)+^-(2l-22)(0,p)] X{zi}, ifzi>Z2, 

\ [(a;2, 2/2) + - (Zi - Z2)(i, 0)] X {Zi}, if Zi < Z2. 

By symmetry, we also see that {xi, yi, zi) ^ {x2, 2/2, 22) if and only if 

D - {xi - X2){0,p), if a;i > a;2, 



(3.5) 



(2/1,^1) e (2/2,22) + 



which is equivalent to 



(3.6) 



{zi,Xi) e {Z2,X2) + 



D - (xi - X2){L0), ifa;i<a;2, 



■D - (yi - y2)(0,_p), if 2/1 > 2/2, 
(2/1 --2/2)(i,0), if 2/1 < 2/2- 



Lemma 3.1. Lei c be an integer written in the form c = ap + b where a,b E Z,, 
0<b<p~l. Then 
.1 



c(-,0) + £> 
P 



{(a,0), ia+l,-p^+pb)}+D 
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Proof. Note that 



c{-,0) + D \ {(a,0), {a + l,-p'^ +pb)} + D 
p i I 

is the indicated region in Figure 5. Obvious, this region does not contain any points 
in Z2 □ 



y 




Figure 5. Proof of Lemma [3TT] 

The restriction of -< on the xy-planc, still denoted by -<, is defined by the 2- 
dimensional cone D: {xi,yi) -< (2:2,2/2) if and only if {xi,yi) -< {x2,y2) + D- It is 
clear that for / C 17 C and c e R, / x {c} is an ideal of x {c} if and only if / 
is an ideal of Vl. 

For integers a < b, let 

[a,b] {x e Z : a < X < b}. 

Following the approach in [H], we can characterize ideals of a rectangle in by 
their boundaries. Such boundaries are called walks. 

Definition 3.2. Let a < b and c < d he integers. A walk in [a, b] x [c, d] is a 

sequence 

(3.7) {xQ,ya), {xi,yi), {xk,yk) 

in [a, b] x [c, d] satisfying the following conditions. 

(i) xo = a OT yo = d] Xk = b or yk = c. 

(ii) For each < j < fc, either {xi,yi) — {xi-i + h, yi-i) for some 1 < h < p 
or {xi,yi) — {xi^i, yi-i — v) for some 1 < v < p^. In the first case, 
((xi_i, ?;i_i), {xi,yi)'j is called a horizontal step of length h; in the second 
case, ((a;i_i, j/i-i), {xi,yi)) is called a vertical step of length v. 

(iii) The steps in the sequence p.7|) alternate between horizontal and vertical. 
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(iv) 1{ a < xo < b and yo = d, the first step is vertical; if Xfc = 6 and c < yu < d, 
the last step in horizontal. 

(v) If the first step is horizontal of length /i, then 1 < h < p — 1\ \i the last step 
is vertical of length u, then 1 <v <p^ — 1 

Let U — [a, b] x [c, d]. For each walk W — ((xq, j/o), • ■ ■ , {xk,yk)) in U, denote 
by iu{W) the lower left part of U bounded by W (see Figure 6), i.e., 

i-u{W) — {{x,y) £ U : X < Xi and y < yi for some < i < fc}. 



10 

(xo,l/o)< 



(xe,ye) W 



Figure 6. A walk W in [0, 10] x [0, 10] and its corresponding ideal i{W), p = 2 
We denote the empty walk in [/ by and define tc/(0) = 0. Then 

W I — > Lu{W) 

is a bijection from the set Wu of all walks in U to the set Tu of all ideals of U. 
In fact, the conditions in Definition 13.21 are necessary and sufficient to ensure that 
for every u G lu{W), {u + D) CiU C lu{W). The inverse map : lu Wu is 
denoted by lou. When U is clear from the context, ijj and ujjj are simply written 
as L and uj. We call a walk W the boundary of the ideal i{W) and i{W) the ideal 
bounded by W . We remind the reader that the boundary here is unrelated to the 
border in [2] 

For two walks VFi, W2 G Wu, we say that Wi < W2 if i(Wi) C l(W2), which 
simply means that Wi is below and to the left of W2. The partially ordered set 
{lu, C) is a lattice where "A" is "n" and "V" is "U". Consequently, {Wu, <) is 
also a lattice with 

VFi A VF2 = i^{i{Wi) n l{W2)) 

and 

Wi\/W2^ uj{l{Wi) U l{W2)). 
We introduce some operations on walks. Let Ui — [ai,bi\ x [ci,di] {i — 1,2), 
where < 6^ and Ci < di are integers, and assume Ui D U2- Let W he a. walk in 
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Ui and let / — lui{W). The restriction of W in U2, denoted by W\u2, is defined 
to be W(72(/n C/2). If U2 C LUi{W), W\u2 is the point (&2,rf2); otherwise, W\u2 is 
the walk in U2 consisting of steps and partial steps of W. (See Figure 7.) 




Figure 7. The restriction of a walk 



For h, u G Z, the shift oiW hy h horizontal units and v vertical units is a walk 
in [ai + h,bi + h] x [ci + v,di + v] and is denoted by + {h, v). 

Let Z be a walk in U2 and let J = iu^iZ)- A walk W in Ui is called an 
extension of Z if W\u2 = Z. Let Zu^ and Z^;^^ be the highest and lowest (the 
largest and lowest with respect to <) extensions of Z in Ui respectively. Then 
Zu^ = coui{K) where K is the largest ideal of C/i such that K Ci U2 = J and 
Z_^^ = uJUiiL) where L is the smallest ideal of Ui such that L (MJ2 = J ■ In fact, 
Z_fj_^ is the boundary of (J + £>) n ?7i. Zui can be obtained from Z easily: If Z 
is the point (62,<^2) (i-e., J = U2), Zu^ is the point (h\,d\). If Z is not the point 
(62,(^2) and Z ^ 0, we extend Z to the lower right with steps alternating between 
horizontal ones of largest possible lengths and vertical ones of length 1 , and to the 
upper left with steps alternating between vertical ones of largest possible lengths 
and horizontal ones of length 1. If Z = and (oi, &i) 7^ (02, 62), we start from the 
point (max{a2 — 1, ai}, max{&2 — 1, ^1}) and extend to the lower right and to the 
upper left as described above. (See Figure 8.) If Z = and (ai, 61) = (02, 62), then 
Zu\ = 0- Z_Ui is obtained in a similar way. (See Figure 9.) 
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Figure 8. Examples of highest extensions, p = 3 





Figure 9. Examples of lowest extensions, p = 3 

We list some obvious properties of restrictions and extensions. Let Ui, i = 1,2,3, 
be rectangles in such that Ui D U2 D U3. Let W he a, walk in C/i and Z a walk 
mUs. We have 

{W\u,)\u,,=W\u„ 

{Zu2)ui = ^'^i' 



4. Enumerating Ideals of U 

In this section we assume r = 3. Since is the identity matrix, A^-invariant 
ideals of U are simply ideals of U. Recall that n = ^(p — 1). Put 

C/ = [0,n]2, 

and partition U as 

n 

U=[j{Ux{i}). 

A sequence of ideals Jq, . . . , Ji-i (or J^+i, . . . , J„) of U is called forward (respec- 
tively, backward) consistent if U}=o ("^i ^ i^}) ideal of C/ x [0, i — 1] (respectively, 
U"^j_i_i(Jj X {j}) is an ideal of f/x n]). An ideal J, of f7 is said to be consistent 
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with Jo, ... , Ji-1 (or Ji+i, . . . , J„) if Jo, . . . , Ji_i, Ji (respectively, Jj, Ji+i, . . . , Jn) 
is forward (backward) consistent. 

Note. In the terminology of Section 2, the statement that Ji is consistent with 
Jo, . . . , Ji-i means that Ji x {i} is compatible with Jj x {j}, < j < i, with respect 
to the partition U = IJj=o(^ ^ {j})- The meaning of the statement that Ji is 
consistent with Ji+i, . . . , J„ is similar. 

Given a forward consistent sequence of ideals Jo, ... , Ji^i (or a backward con- 
sistent sequence J^+i, . . . , Jn), our goal in this section is to enumerate all ideals Ji 
of U which are consistent with Jo, ... , Ji-i (or J^+i, . . . , J„). When n < p, the 
problem is trivial: In this case, the partial order ^ in is the cartesian product of 
linear orders, hence Ji is consistent with Jo, . . . , Ji-i (or Ji+i, . . . , Jn) if and only 
if Ji C Ji-i (or Ji Z) Ji+i-) When n > p, the problem is more complex. The main 
result of this section is the determination of two walks Xi and Yi in U, which can 
be computed from the boundaries of Jo, ... , Ji_i (respectively, the boundaries of 
Ji+i, . . . , J„), such that Ji is consistent with Jo, ... , Ji-i (or Ji+i, . . . , Jn) if and 
only if X, <u;{J,) <Y,. 

Lemma 4.1. Let i be an integer with <i <n and let Ji be an ideal of U . 

(i) Let Jo, . . . , Ji-i be a forward consistent sequence of ideals of U . Then Ji is 
consistent with Jo, ... , Ji-i if and only if 

(4.1) [Jj+D-{i-j){0,p)]nUcA, 0<J<i 
and 

(4.2) [J^+D+ {a, 0)] n [/ C J._ap-6, 

(4.3) [ J, + £» + (a + 1, + pb)] nU C J^-ap-b 

for all a,b £ 1j with a>0,0<b<p~l,ap + b<i. 

(ii) Let Ji+i, . . . , J„ be a backward consistent sequence of ideals of U . Then Ji 
is consistent with Ji+i, . . . , Jn if and only if 

(4.4) [j, + D-{j-i)iO,p)]nU CJ,, i<j<n 
and 

(4.5) [J^+ap+b + D + {a,0)]nU C J„ 

(4.6) [Ji+ap+b + D + {a+l,-p'^+pb)]nU CJ^ 
for all a, 6 G Z with a > 0, < b < p — 1, i + ap + b < n. 

Proof, (i) By Lemma 12.11 (ii), J; is consistent with Jo, ... , Ji-i if and only if for 
every < j < i, 

(4.7) {J, X {j} + A) n ([/ X {i}) dJ.x {i} 
and 

(4.8) (J, X {z} + A)n{Ux {j}) c J, X {j}. 

However, by (|3.4p . we see that (|4.7p is equivalent to (|4.ip and (|4.8p is equivalent to 

(4.9) [A + D + {i~j){-,0)]nU cJj. 
By Lemma [Xn (gjH) is equivalent to ((i?^ and (|33]). 
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The proof of (ii) is essentially the same. 



□ 



Lemma 4.2. Let J and K he ideals of U with boundaries W and Z respectively. 
Let a > and b > be integers and let K be the largest ideal of [0, a + n] x [~b, n] 
such that K nU ^ K . Then the following conditions are equivalent. 



(4.10) 

(ii 
(4.11) 

(iii 
(4.12) 

(iv 

(4.13) 

(v 
(4.14) 

(vi 
(4.15) 



[J + D+ (a, ~b)] nU CK. 
J + ia,-b) c K n {{a,-b) + U). 
[J + D + (a, -b)] n ([0, a + n]x [~b, n]) C K. 
\(W+(a,^b)), , , 1 L< Z. 

W+{a,~b)< [Z[o,a+„]x[-M] \[a,a+n]xl-b,-b+n] 



Proof. Condition (iv) is a restatement of (i) in terms of boundaries. In fact, 



[{W + (a, -&))jp a+n]x[-b n]] \u^^ boundary of [j+D+{a, —b)] HU. In the same 
way, (ii) 44> (v) and (iii) <^ (vi) . Condition (vi) follows from (iv) through the oper- 
ation ( )[o a+?i]x[-6 n]' Condition (iv) follows from (vi) through the operation ( )|;7. 
Similarly, (v) <^ (vi) through operations 



-[0,a+n] X [—b,n] 



and ( j|[a,a+n]x[-6,-f)+n]- 
□ 



-b+n 




s — o : Lj{K) 

•— • : tj([J+r>+(a,-6)]n([0,a+n]x[-6,Ti]; 



Figure 10. Illustration of Lemma 
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Lemma 4.3. Let J,K,L be ideals of U and let b,c be positive integers. If 

(4.16) [J + L» + (0, -6)] n [/ C if 
and 

(4.17) [/C + L» + (0, -c)] n [/ C L, 
then 

(4.18) [j + D+{Q,-b-c)\r\U <ZL 

Proof. Let K be the largest ideal of [0, n] x [—6 — c, — c + n] such that 

(4.19) K n ([0, n] X [-C, -c + n]) =K+ (0, -c). 
Then by and Lemma [121 

(4.20) J+(0,-6-c) ci4:n([0,7i] X [-6-C, -6-C + 71]). 

Let L be the largest ideal of [0,n] x [—6 — c, n] such that LOU — L. Put L = 
Ln ([0,n] X [— c, n]). Clearly, L is the largest ideal of [0,n] x [~c, n] such that 
LnU = L. Thus by (liTT]) and Lemma 1121 

(4.21) K + (0, -c) C L n ([0, n] x [-c, -c + n]) = Z n ([0, n] x [-c, -c + n]) . 
Let L be the largest ideal of [0, n] x [—6 — c, — c + n] such that 

(4.22) L n ([0, 7i] X [-C, -c + n]) = L n ([0, n] x [-c, -c + n]) . 
We claim that 

(4.23) L = Ln{[0,n]x[-b-c,^c + n]). 

In fact, uj{L) is the highest extension of a;(Ln ([0, n] x [— c, rt])) ; uj{L) is the highest 
extension of a;(Ln([0, n] x [— c, — c+n])) . Since both extensions follow the same rules 
(described in the last paragraph of Section 3), the new steps (in [0, n] x [— 6 — c, — c]) 
in both extensions are identical. Therefore ()4.23p is proved. 

Note that K is an ideal of [0, n] x [-6 - c, -c + n] and that by (|4?T9l) and ([42T|) . 

X n ([0, n] X [-C, -c + n]) C Z n ([0, n] x [-c, -c + n]) . 

By the maximality of L, we have K C L. However, (|4.23p implies that L C L. 
Thus we have K C L. Hence by (|4.20p . we have 

J+{0,-b-c) cZn([0,n] X [-5-C, -6-c + n]), 

which, by Lemma l472l implies (|4.18p . □ 
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-c+n 



-b—c+n 



-6-( 



w(,/+(0,-b-c)) 



Figure 11. Illustration of Lemma 

Lemma 4.4. Let J, K, L be ideals of U and let a, b, c, d be nonnegative integers. 
Assume that 

(4.24) [j + D + {a,-b)]r\U CK 
and 

(4.25) [K + D+ (c, -d)] nU CL. 

Furthermore, assume that K ^ 9, K ^ U and that uj{K) is not a single horizontal 
step. (Note that when n > p, uj{K) is never a single horizontal step.) Then we 
have 

(4.26) [J + D + {a + c,-b-d)\r\U (ZL. 

Proof. Let L be the largest ideal of [0, a + c + n] x [—6 — d, n] such that LCiU — L 
and let K be the largest ideal of [c, a + c + n] x [—5 — d, ~d + n] such that 

K n ([c, c + n]y. [-d, -d + n]) = K + (c, -d). 

By (liTM)) and Lemma g^l 

(4.27) J + (a + c, -6 - d) C ^ n ([a + c, a + c + n] x [-b- d,-h- d + n]) . 

Put L = Zn([o, c + n] X [— d, n]). Clearly, L is the largest ideal of [0, c + n] x [— d, n] 
such that 

(4.28) Lnu^L. 
By (liT^ and Lemma gjll 

(4.29) K + (c, -d) C i n ([c, c + n] X [-d, -d + n]) . 
Let K be the smallest ideal of [0, c + n] x [— d, n] such that 

k n ([c, c + n] X [-d, -d + n]) = + (c, -d). 
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By ()4.29|) and the minimality of we have 
(4.30) k (ZL. 

The walk ui{K) is an extension of lo{K + (c, — d)) to the upper left; the walk lo{K) 
is an extension of lo{K + (c, —d)) to the lower right. (See Figure 12.) Since K + 
(c, ~d) K + (c, —d) ^ [c, c + n] x [— d, — d + n], and since oj{^K + (c, — d)) is not 
a single horizontal step, the union (in the obvious sense) of the walks ij->{K) and 
uj{K) is a walk in [0, a + c + n] x [—6 — d, — 6 — d + n] . Denote this walk by W . Note 
that 

t(M^) n [/ = n c/ 

cine/ (by (143011 ) 
= i (by 6281). 

Thus by the maximality of Z, we have l{W) C L. Hence 

J +{a + c,-b-d) 

ZK r\{[a + c, a + c + n] x [-b-d,-b-d + n]) (by (g^Il)) 

= i(W^) n ([a + c, a + c + n] X [-6 - d, -6 - d + n]) 

C L n ([a + c, a + c + n] x [-6 - d, -6 - d + n]) . 
By Lemma lO (j4:26| follows. □ 
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o — o : Lo{[.I+D+{a+c,-b-d)]n{[0,a+c+n]x[-b-d,n])) 
p=2 



Figure 13. A counterexample of Lemma [44l K = $ 



I 



a — e : t^[[.J+D+(a+c,-b-d)]n{[a.a+c+n]x[-b-d,n])) 
>^ : c^(L) 

• — • : Lj{[K+D+{c,-d)]ni[0,c+n]x[-d.n])) 
p=2 

Figure 14. A counterexample of Lemma [HH K = U 
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e o : i^(^[J+D+{a+c,-b-d)]n{[0,a+c+n]x[-b-d,n])) 

X X : t^{L) 

• • : uj{[K+D+{c.~d)]n{[0,c+n]x[-d,n])) 

p=l 

Figure 15. A counterexample of Lemma ^{K) is a single horizontal step 

Theorem 4.5. Let i he an integer with < i < n. Let J^+i, . . . , Jn be a backward 
consistent sequence of ideals of U and let Jj be an ideal of U . Then Ji is consistent 
with Ji+i, . . . , Jn if and only if the following conditions are satisfied. 

(i) Ji D Ji+i. 

(ii) [j, + D-{0,p)]nU C J^+i. 

(iii) [Ji+p + D + (1, 0)] n ?7 C Ji- (If i + p > n, this condition is null.) 

(iv) Let ai be the largest integer such that l<ai<p— l,i + ai<n and 
Ji+a^ 7^ 0- Then [Ji+at + L) + {1, —p^ + pai)] Ci U C Ji. (If such an ai 
does not exist, this condition is null.) 

Proof. First note that the theorem holds when n < p. In fact, in this case, since 
the partial order in is the cartesian product of linear orders, Ji is consistent 
with Ji+i, . . . , Jn if and only if (i) is satisfied. Meanwhile, as one can easily see, 
(ii) is automatically satisfied; (iii) is null; (iv) is either automatically satisfied or is 
null. Therefore we assume n > p. 

We show that (|4.4p - (14. 6p in Lemma 14.11 together are equivalent to conditions 
(i) - (iv) in Theorem 14.51 

(=>) Condition (i) follows from (|4.5p with a — and b = 1 since [Ji+i + D]r\U = 
Ji+i. Condition (ii) is a special case of (14. 4|) . Conditions (iii) and (iv) are special 
cases of (|4?5]) and (|46|) . 

(<^) To prove (|4.4p . let i < j < n. By (ii) and the fact that Ji+i, . . . ,Jn is 
backward consistent, we have 

[J^ + D-{o,p)] nc/cJ,+i, 

+ D-{j^i^ i)(o,p)] nuc Jj, 

Thus by Lemma l473l 

[j, + D-{j -i){o,p)] nucJj. 

To prove (|4.5p . let a,b e Z with a>0,0<b<p-l,i + ap + b<n. We may 
assume a > 1 since (|4.5p becomes obvious when a — 0. By (iii) and the fact that 
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Ji+1, . . . , J„ is backward consistent, we have 
(4.31) 



[j^+p + D + (1,0)] nc/c J„ 

[Ji+ap + D + {a-l,0)]r\U C Ji+p. 



We claim that 

(4.32) [j,+ap + D + {a,0)]nU CJ,. 

In fact, if Ji+p ^ and Ji+p ^ U, then (|4.32p foUows from (|4.31[) and Lemma [44l 
If Ji+p = 0, then by (i), Ji+ap = since Ji+i, . . . ,Jn is backward consistent. Thus 
(|432l) holds. If Ji+p = J7, by (i), we have Ji ^ U and (|432l) also holds. Since 

Ji+ap+b C Ji+ap, we have 

[Ji+ap+6 + + (a, 0)] n C/ C [j,+ap + D+[a,Q)\r\U dJi. 
Finally, we prove (|4.6p . We may assume 6 > 1, since if 6 = 0, we have 



(4.33) C 



Ji+ap + i:' + (a + i,-p2)] nc/ 

Ji+ap + D + {a, 0)] n U (since (1, -p^) e D) 



cJ. (by 632])). 

In (iv), if ai does not exist or Ui < b, then Ji+h = 0. Hence Ji+ap+b = and we are 
done. So assume that ai > b. By (iv) and the fact that Ji+i, . . . , Jn is backward 
consistent, we have 

+ D + (l,-p'^+pai)] nU cJi, 
(4.34) <^ [j,+fc + D + {0, -p{a, - b))] nU C J,+„. , 

[ [Ji+ap+6 + D + {a,0)]nU C J,.+b. 

If neither of Ji+a and Ji+f, is or t/, by (|4.34p and Lemma we have 

[Ji+ap+b + D + {a + l, -p'^+pb)] n [/ C J., 

which is (|4.6p . If one of Ji+c^ and Ji+t is or [/, then Ji+f, = or Ji+t = U or 
Ji+a, = U since Ji+a^ 7^ 0. Thus Ji+ap+b = or Ji = [/ and (|4.6p also holds. □ 

Theorem 4.6. Jei i be an integer with < i < n. Let Jq, . . . , Ji-i be a forward 
consistent sequence of ideals ofU and let Ji be an ideal ofU. Then Ji is consistent 
with Jo, ... , Ji-i if and only if the following conditions are satisfied. 

(i) Ji C Ji-i. 

(ii) J, 3 lJ^i+D-{0,p)]nU. 

(iii) [Ji + D + (1, 0)] n [/ C Ji-p. (If i — p <Q, this condition is null.) 

(iv) Let Pi be the largest integer such that 1 < Pi < p — I, i — Pi > and 
J,_^^ / U. Then [Ji + D + {1, -p'^+pPi)] nU C Ji-p,- (If such a P^ does 
not exist, this condition is null.) 

Proof. By the same reason in the proof of Theorem 14.51 we may assume n > p. 

We show that (|4.ip - (14. 3p in Lemma 14.11 together are equivalent to conditions 
(i) - (iv) in Theorem 14.61 Since the proof is essentially the same as the proof of 
Theorem 14.51 we only show that (i) - (iv) of Theorem 14.61 implv (|4.3p . 

Let a, b be integers such that a>0, 0<5<p— 1 and i — ap — b > 0. By an 
argument similar to (|4.33p . we may assume 6 > 1. In (iv), if Pi does not exist or if 
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Pi < b, then Ji-b = U. Hence Ji-ap-b = U and (14. 3p is obvious. So we may assume 
that Pi > b. By (iv) and the fact that Jq, . . . , Ji-i is forward consistent, we have 

([J^ + D + (1, nu c J,_ft, 
(4.35) I [J,_ft + + (0, -p(A - b))] nuc J,-b, 

[ [J,_fc + D + {a,0)]nU C J,-ap-b- 

If neither of Ji_{, and Ji-/?; is or U, (|4.3p follows from (|4.35[) and Lemma [4.41 
If one of Ji_h and Ji-fS^ is or J7, then Ji_b = or Ji_b = {/ or Ji_/3. = since 
■^i^/Si 7^ C^- Thus Ji-ap~b = ?7 or Jj = 0; in cither case, ()4.3|) holds. □ 

Corollary 4.7. (Backward slicing) Let i be an integer with < i < n. Let 
Ji-)_i, . . . , Jn be a backward consistent sequence of ideals of U and let Ji be an ideal 
of U. Put Wj = uj{Jj), i <j <n. Let 

,,,,, ^^-^-^^t(lW(M)),,„,,,,,J.] 
(4-36) , ..2^^^.V 



V +(1, V+Pa.)). 



where Ui is defined in Theorem \4-5\ (iv), and 

(4.37) y^^W^)[o,nM^p.n] l[o,„]xhp,-p+„] +(0:P)- 
Then Ji is consistent with Ji+i, . . . , Jn if and only if 

(4.38) X,<W^<Y,. 

Note. In (|4.36p . if i +p > n, the walk after the first V is not defined; if ai does not 
exist, the walk after the second V is not defined. Our convention, here and later, is 
that any undefined walk in a V or A operation is ignored. 



Proof. The corollary is a restatement of Theorem 14.51 in terms of boundaries. In 
fact, conditions (i), (iii) and (iv) of Theorem 14.51 are equivalent to 

W^.>(IW(M)),,„,,,,,„,I.. 

> (iy.+.. + (1, ~P'+P-^)) ,,^n^,,^,_,,^^^Ju- 

By Lemma 14.21 condition (ii) of Theorem 14.51 is equivalent to 



□ 



Corollary 4.8. (Forward slicing) Let i be an integer with < i < n. Let Jq, . . . , Ji~i 
be a forward consistent sequence of ideals of U and let Ji be an ideal of U . Put 
Wj = uj{Jj), 0<j<i. Let 

(4-39) (W^.-i-(0,P)) ,„ , , Au 

and 
(4.40) 

r/ =W,^, A [(W^.-p)[o,„+i]x[o,„] I [!,„+!] x[o,„] -(I'O)]^ 

[{^i-0i)[O,n+l]x[-p^+p(3,,n] I [l,n+l] X [-p2+p/3,,_p2+p^,+„] -(1:~P + PPi)] : 
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where f3i is defined in Theorem \4-6\ (iv). Then Ji is consistent with Jo, ... , Ji-i if 
and only if 

(4.41) X'i <W^< ¥(. 



Proof. The corollary is a restatement of Theorem 14. 61 in terms of boundaries. By 
Lemma 14.21 conditions (i) , (iii) and (iv) of Theorem 14.61 are equivalent to 



< (WVp)[o,«+l]x[0,n] l[l,,i+l]x[0.n] ^^^^)^ 
Wi < (W'i-ft)[o^„+i]x[-p2_,_p^. „] I x[_p2+p^.__p2+p^.+„] -(l,-P^+P/3i)- 

Condition (ii) of Theorem 14.61 is equivalent to 



-[0,n] X [~p,n\ 



□ 



Example 4.9. (Backward slicing) Let p = i and m — 12 {n — ^{p — 1) — 8). 
A backward consistent sequence of ideals Jg, J7, . . . , Jq is illustrated in Figure 16 
through their boundary walks Wg, W^v, . . . , Wq. When choosing walk W^, we first 
determine the lower bound Xi and the upper bound Yi defined in Corollary 14.71 
Figure 17 shows how Yi is determined and Figure 18 shows the procedure to find 
Xi. The ideal / = [fj^^iJ] x {j}) of is depicted in Fi gure 19. 
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W7, a7 = l 




We, oc6 = 





W5, 05=2 



W4, a4=2 



W3, 03 = 



W2, 02=2 



Wi-. 



Wi, ai=2 
Xii X — X K: s — o 



Wo, ao 



Figure 16. An example of backward slicing 
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(0,3) 



Figure 17. Determination of Y\ 



W4 + (l,0) 




Figure 18. Detremination of X\ 
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y 

8 




Figure 19. The ideal / ^ Uj=o('^- x Ol) 

Example 4.10. (Forward slicing) Let p — 3 and to = 9 (n = y(p — 1) = 6). 
A sequence of walks Wq, Wi, . . . , Wq satisfying (|4.4ip is given in Figure 20. The 
resulting ideal / = Uj=o('^(^i) ^ {j}) '^^ ^ illustrated in Figure 21. 
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Figure 21. The ideal / = Uj=o(^(^j) x Ol) 
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5. Enumerating A-Invariant Ideals of U 

In this section, we consider the case r = 1. Therefore, we are interested in ideals 
of U which are invariant (symmetric) under the action of A. The problem here is 
more difficult than the one in Section 4. 

In order to enumerate the ^-invariant ideals of U, we partition U as 

n 
i=0 

where 

Vi = {(x, y,z)^U:x<i,y<i,z<i and at least one of x, y, z is z}. 

For any subset X C , we denote its image under A, i.e., {xA : x G X}, by X"^. 
Put 

V, = [0,i]2 X {i}. 

Then 

Let / be an ^-invariant ideal of Vj . Write 

inVi^ J X {i}. 

Then J is an ideal of [0, i]'^ such that 

/ = ( J X {z}) U ( J X {z})'4 U ( J X {z})^' 

and 

(5.1) {x : (x,i) e J} = {y : (z,2/) e J}. 

On the other hand, if J is any subset of [0, z]^ satisfying ()5.ip . then the A-invariant 
subset I = {J X {z}) U ( J X {z})^ U ( J x {z})^' C Vi has the property that lr\Vi = 
J X {i}. 

Let Jj {0 < j < i) be an ideal of [0, j]^ such that 

(5.2) {x:{x,j)eJ,} = {y:{j,y)eJ,}. 
We call the sequence Jq, . . . , Ji-i consistent if 

U[(J, x{j})U(J, xO-})^U(J, xO-})^^ 

i=o 

is an A-invariant ideal of [0, z — 1]'^. The ideal Ji of [0, z]^ is said to be consistent with 
Jo, . . . , Ji-i if the sequence Jq, . . . , Ji-i, Ji is consistent. Note that the meaning of 
consistency here is different from that of Section 4. 

Note. In the terminology of Section 2, the statement that Ji is consistent with 
Jo,...,ji-i means that lJs=o('^« ^ {*})"^ compatible with lJs=o("^i ^ {j})"^ > 
< j < z, with respect to the partition U = Uj=o ^i- 

Given a consistent sequence of ideals Jq, . . . , Ji_i and an ideal Ji of [0, z]^. Our 
goal in this section, roughly speaking, is to determined two walks $i and 4'i in 
[0, z]^ such that Ji is consistent with Jq, . . . , Ji_i if and only if $i < w( Ji) < 5'i. 
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Lemma 5.1. Let < i < n. Let Jj (0 < j < i) be an ideal of [0,j]^ such that 
Jo, ... , Ji^i is a consistent sequence. Write 

i-l i-l 

(5.3) U [(J, X {j}) U (J, X {j})^ U (J, X {j})^'] = y (J,,, X {j}), 

3=0 j=0 

where J-i j {0 < j < i — I) is a ideal of [0, i — 1]^, and write 

uj{Ji) = ((xo,yo), ■ ■ • , (a;fc,yfe)). 

Then Ji is consistent with Jq, . . . , Ji-i if and only if the following conditions are 
satisfied: 

(5.4) {xo,yo) = {yk,Xk) ifyo^i. 

(5.5) ( J, X {i} + A) n ([0, i-lf X {j}) C Jij X {j} for all < j < i. 

(5.6) ( J,j X {j} + A) n C X {i} for all < j < i. 

(5.7) (J, X {i} + A) n K;^ C (J,; X {z})^. 

(5.8) (J, X {z} + A) n K;^' C (J. X {j})^'. 

Proo/. Let L = {Ji X {i}) U ( x {i})^ U ( x {i})'^^ and denote by /' the ideal of 
[0,i- 1]3 in (jOl) . 

(=^) Equation (|5.4p follows from (|5.2p . Since Jq, . . . , Ji-i, Ji is a consistent 
sequence of ideals, / U /' is an ideal of [0, i]"^. By Lemma \2A] (ii), we have 

'(/ny, + A) n [0,^-1]^ c /', 

(/' + A) n c / n y„ 
(/ny, + A)ni^,^c/ny,'4^ 

U/ n t/, + A) n v^/' c / n v/^\ 

These inclusions are equivalent to (|5.5p - (|5.8p respectively. 
(<;=) First, from (|5.4p . we have 

: (a;,i) £ J.,} = {?/ : (i,?/) G Jj. 

Thus (cf. the statement after (|5.ip ). 

(5.9) my, = j, x{z}. 

From (jO)) . and (gUD, we have 

(/ny + A)ni//' c/ny,^', fc = o,i,2. 

Hence 

(/ n y + A) n Vi c /. 

Since / is A-invariant, we have 

(/ + A) n V, c /, 

which means that / is an ideal of V,-. 
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From ([SJ]) . (1531) . and we have 

^{Inv^ + A)n[o,i~lfc^, 
\{r + A)nv,cinv,. 

Since both / and /' are ^-invariant, we obtain 

('(/ny,^' + A) n[o, c/', 
\{i' + A)nv,^'' cinv^", 

Therefore, 



k = 0,1,2. 



(5.10) 



(/ + A)n[o,i-i]3 c/', 
(/' + A) n V, c /. 



By (|5.10p and Lemma [2.11 (ii), / U /' is an ideal of [0,i]'^, i.e., Jq, . . . , Ji-i, Ji is 
consistent. □ 

Lemma 5.2. /n Lemma [5l\ ([O]) - ([O]) imp^?/ (ISJ]) . 

Proof. First assume i < p. In this case, the partial order ^ in [0, i]^ is the cartesian 
product of linear orders and (|5.7p follows from (|5.4p trivially. (See Figure 22.) 




boundary of Ji X {i} 
boundary of {JiX{i})^ 
boundary of (JiX {i}+A)nV/^ 



X X 



Figure 22. {J, x {i} + A) n V/^ C {J^ x {z})^ when i < p 
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So we assume that i > p. Let / and /' be as in the proof of Lemma 15.11 Note 
that / n V^i = J, X {i} by (jO]) . 

For each u= {x',i,z') S (Ji x {i}+A)nFj"^, we want to show that u e {Jix{i})^. 
Note that there exists {x, y) € Ji such that u -< {x, y, i). 

Uy = i, then {x, y, i) G {Ji x {i}) n V^^ = / n n V/^ C (/ n = x {O)'^- 
Since ( x {i})^ is an ideal of V/^, we have u & {JiX {i})^- Thus we assume ?/ < i. 

If z' — i, then (x' -< {x,y,i) imphes {x',i) -< {x,y), hence {x',i) € Ji. By 
(|5.4|) . (i,a;') e J^, hence it = {x',i,i) = {i,x',i)A £ {Ji x {i})'^. Thus we assume 
z' < i. 

By p.6[) . (x', i, z') ^ (x, y, i) if and only if 

{x', i, z') -< {x, i, i) - (i - y){p, 0, 0) = (a; - (i - y)p, i, i). 

Thus we have 

{x',i,z') ^ {x',i,z') + {p,-l,0) 

^ {x- {i- y)p, i, i) + {p,-l,Q) 
= (x - (i - 1 - y)p,i- 
= {x,y,i) + {i-l-y){-p,l,0) 
-< {x,y,i), 

i.e., 

(5.11) {x',i,z') ^ {x' +p,i - l,z') -< {x,y,i). 

If {z',x') ^ {x,y), then (z',a;') e Ji. Thus (a;',i,z') = (z',a;',i)A e (J, x {z})^. 
Therefore, we assume {z',x') {x,y). 
We claim that 

(5.12) x'<i-p. 

In fact, since (x', z') ^ {x — {i — y)p, i, i), we have (z', x') -< {i,x — {i — y)p), i.e., 

(5.13) x' <x- {i-y)p+-{i- z'). 

P 

If z' > x, (|5.13p gives 

x' < X — {i — y)p H — {i — x) 
P 

p - I p2 - 1 

— X + py 1 

P P 

< 1 + pyi — 1) 1 

P P 
~ i — p. 

If z' < a;, since (z', x') 7^ (a;, y), we must have 

(5.14) x' >y+-{x-z'). 

P 

Combining ([STS]) and dSH]) . we have 

X - (i - y)p + -(i - z') > y + - (a; - z') 



30 



XIANG-DONG HOU 



which gives 

1 1 - I p-l 

(p — l)y > —X — X + pi i — i x, 

p p p p 

i.e., 

y > « — X > t, 

p p 

which is a contradiction. Thus (|5.12p is proved. 

Now we have {x' + p,i — 1, z') ^ (x, y, i) and (x' + p, i — 1, z') E [0, i — l]"*. By 
([531) . [x' +p,i-l,z') € {J^ X {i} + A)n[0,i-l]3 c /'. Thus we have 

C (Ji X {i})-^ (by fO]) and the ^-symmetry of /'). 

□ 

Lemma 5.3. Assume that in Lemma \5.1[ (|5.4p - (|5.7p are satisfied. Then (|5.8p is 
equivalent to 

(5.15) max{?/ : (i — 1, G Ji} < maxja; : (x, i — p) S Ji} if i > P- 

Proof. First assume i < p. Then (|5.15p is satisfied without instance. Since in case, 
the partial order -< in [0,*]'^ is the cartesian product of hnear orders, (|5.8p holds 
trivially. (See Figure 23.) So we assume that i > p. Again, let / and /' be as in 
the proof of Lemma 15.11 




Figure 23. ( x {i} + A) n V/^" C {J^ x {i})'^' when i < p 
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Proof of " (I0511 jSH)". Let u ^ {i, y' , 2') £ (J, x {i} + A) n y^^'. We want 
to show that u (1 {Ji x {i})^ . 

Note that there exists {x,y) G Ji such that u -< {x,y,i). Also note that (|5.4p 
imphes that I nVi = Ji x {i}. 

Ux = i, then ix,y,i) G ( x {i})nV^,^' = iDV.nV^^ C (/nyi)'^' = iJ,x{i})^\ 
Since ( Ji x is an ideal of V/^ , we have u e {Ji x {i})^ . 

Next, assume x < i — 1. By p.Sp . (i, y', z') ^ (x, z) if and only if 

{hv'.z') -< {i,y,i) -{i- x)(0,0,p) = {i,y,i~p{i - x)). 

Thus we have 

{i,y',z') -< {i,y,i-p{i - x)) 

-< {hy,'i-p{-i -x)) + {i-x- l)(-l,0,p) 
= {x + l,y,i~p) 
-< {x,y,i), 

i.e., 

(5.16) u = {i, y', z') <{x^\,y,i-p) < (x, y, i). 

If y = z, then 

ix + l,y,i-p)e (J. x {t} + A)nv^ 

C {J^ X {i})^ (by (EH)). 

Thus 

[(J, X {i})^ + A]nvf 
e [(j.x« + A)ny,^]^ 

C (J, x {i})^^ (by (HJl again). 

If y < i, then {x + l,y,i ~ p) £ ( Jj x {i} + A) ("1 [0, i - 1]^ C /'. Hence we have 

ue{r + A)nv^' (hv (ICTi ) 

C (Ji X {i})"^^ (by ((5?6)) and the A-symmetry of /'). 

Finally, assume x ^ i — 1. By (|3.5|) . we have 

((a;, y, i) + A) n F,-^' = {i} x [{{y, t ^ p) + D) n [0, f ] . 

(See Figure 24.) However, by (|5.15[) . y < max{a; : {x,i —p) G Ji). Thus (y,z — p) G 
Ji. Therefore, 

mG ((a;,y,i) + A) n V^^' 
= {i}x [((y,z-p) + i^)n[0,i]2] 
C {i} X Ji 
= (J.x{^})^^ 
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Proof of "dSH) (|5A5l) ". We may assume that {y : {i - l,y) S J^} 7^ 0. Let 
y = max{?/ : {i — l,y) £ Ji}. Then (i — 1, y) e J.;. Hence 

Wx [{iy,t^p) + D)n[0,i]^] 
= {{t-l,y,i) + A)nV^^" (by em) 

C (J. X {z} + A) n 

C (J. X (by eH)) 

= {«} X Ji. 

In particular, {y,i — p) G Ji. Therefore 

y < max{x : {x,i — p) G Ji}, 

which is ((57T5)1 . □ 

Lemma 5.4. Let J be an ideal of [0, i — 1]^ and JC an ideal of [0, i]^. Let b > be 

an integer. Then 

(5.17) [J + D + {0,~b)]n[0,i]'^ C K 
if and only if 

(5.18) [J + D + (0, -6)] n [0, i - 1]2 c n [0, i - 1]2. 

Proof We only have to prove that (jSlS)) =^ ([STZ)) . Let {x, y) e [J + D + (0, ~b)] n 
[0,i]^, we want to show that {x,y) £ K. 

If (a;,y) £ [0,i— 1]^, we are done by (IS.lSp . So assume (x,?/) ^ [0, z — 1]^, i.e., 
x = I or y = i. 

There exists {x',y') £ J + (0,-6) such that {x,y) -< {x',y'). If y' > 0, then 
{x',y') £ [0,i-l]2, hence (a;',y') £ [J+D + {Q,-b)]C\[Q,i~lY C Js:n[0,i-1]2 c K. 
Therefore (x, y) £ K. 

If 2/' < 0, since {x, y) -< {x' , y'), we must have x < x' . By the assumption, y — i. 
From Figure 25, we have 

(x, i) (a;' - (i - 1 - ?/')P; i - l) ^ {x , y') 
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and 

x' - {i - 1 - y')p e [x, x'] C [0, ?:-!]. 

Hence {x' - {i - 1 - y')p, i-l) E [J + D + {0, -b)]n[0,i - l]^ C K n[0,i - l]"^ C K. 
Therefore, we also have (a;, y) E K . □ 



slope—— — 



(x' -{i-l-y')p, i-l) 



Figure 25. Proof of Lemma [51^ 

Lemma 5.5. Let J and K he ideals of [0, i — 1]^ where i > p and J ^ [0, i — 1]^, 
J ^ %. Let b,c > be integers. Let J be the largest ideal of [0, i]^ such that 
J n [0, « - 1]^ = J and k the largest ideal of [0, iY such that X n [0, i - 1]^ = K. If 

(5.19) [J+{b,^c) + D]r\[Q,i-lf dK, 
then 

(5.20) [J +{b,-c) + D\r\[Q,if dk. 
Proof. Let uj{J) = W and uj{K) = Z. Then uj{k) = Z[o.,]2, 



and 

(5.21) 

where 



;(J + [h, -e)) = {W + {h, -c))[,.,+,j,f_,,_,+,], 

.([J + [b, -c) + D] n [0, ir) = ^(i + (^-c)) ^„^,^,,,_j 



Y = 



W+W^lt,b+^]x[-c,-c+^]] 



{0,b+i]xl-c,i] 



Since J ^ [0,^-1]^ and J 7^ 0, we have J ^ [0,^]^ and J 7^ 0. Thus cj( J+ (6, -c)) is 
neither nor the single point {b+i, —c+i). Since i > p, ijj( J+(&, — c)) is not a single 
horizontal step. Therefore, the extension from a;( J+ (6, ~c)) to Y requires the same 
additional steps as the extension from W + (&, — c) to {W + {b, — c))^ 

(See Figure 26.) Thus Y is the union (in the obvious sense) of 
(5.22) a!l±(^^[o,.+.-i]x[-,, c.(J+(6,-c)). 



-[0.b+i-l]x[-c,i]' 



By (Isrg)) . we have 
(5.23) iW+{b,-c)) 



[0,f)+i-l]x[-c,i-l] I [0,1-1] 



< z. 



By (15.221) . F is an extension of (W + (b, —c)), , , hence an extension 



Of {W + {b,~c)) ^^^^^^_^^^^_^^^_^^ 
Taking restriction on [0, z]^, we have 



Thus gives Y < Z[o,b+,,]x[-c,.]- 
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Using (15.211) . we have 

L0{[J + {b, -C) +D]n [0, < Z[o,^]2 = Loik), 

which proves (|5.20|) . 



□ 



i-l 



i — l — c 



: Y 



Figure 26. Proof of Lemma 15.51 
Lemma 5.6. In Lemma [57J[ let Wij = uj{Ji,j) (0 < j < i) and Wi — oj{Ji). Set 



(5.24) 

and 
(5.25) 



[0,i]x-[-p,i] nO,iV 



iW^^^-l)[OA-^[^^^^^-p\o,l+^MO,^] I [1,1+.] X [0,»] "(l'^)]^ 

where f3i is the largest integer such that l<l3<p— l,i — Pi>0 and Jij-p^ ^ 
[0,i — 1]^. (If Pi does not exist, the last walk at the right hand side of h5.25\l is 
ignored.) Then (|5.5p and (|5.6p hold if and only if 

S, < Wr < T,. 



Proof. We will show that (|5.6p is equivalent to Si < Wi and that (|5.5p is equivalent 
to W^ < T,. 

First we claim that (|5.6p is equivalent to 

(5.26) [J,j + D-{i- j){0,p)] n [0, if C Ji for all < j < i 
and that (|5.5p is equivalent to 

(5.27) [J^ + D + {a, 0)] n[0,i- l]^ c J^,^-ap~b 
and 

(5.28) [j^ + D + {a+ 1, V + bp)] n[Q,i- if C J^,^-ap-b, 
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where a,b Z, a > 0, < b < p — 1 and ap + b < i. The proof of these claims is 
the sarae as the proof of Lemma 14.11 (i) . 

Therefore, it suffices to estabhsh the fohowing relations: 

Km and Km ^ Wi < Ti. 

Proof of " ([5:261) ^ S^ < W^" . By Lemma [531 ([061) is equivalent to 

(5.29) [J,j + D- {i-j){0,p)] n[0,i- 1]2 <zJ^n[0,i- 1]^ for aU < j < i. 
Since \J]^\{Jij x {j}) is an ideal of [Q,i - 1]^, we have (cf. (|4.ip ) 

(5.30) [J^J +D~{i-1- j){0,p)] n [0,i - 1]2 C J^,,_i for all < j < i. 

Note that Lemma remains true with [0, i — 1]^ in place of U. Thus by Lemma 
and (|5.30p . we see that (|5.29p holds for all < j < i if and only if it holds for 
J = i — 1, i.e., if and only if 

(5.31) [j,,,_i + z?-(o,p)] n[o,i-i]2c J,n[o,i-i]2. 

By Lemma [531 again, (|5.3ip is equivalent to 

(5.32) [J,,,_i (0,p)] n[0,if CJ^. 
In terms of boundaries, (|5.32p is equivalent to Si < Wi. 

Proof of "dOZD and ([051) ^ < T,". Let (0 < j < i) be the largest ideal 
of [0,i]^ such that Jij fl [0, z — 1]^ = Jij. We claim that Wi < Ti is equivalent to 
the following three conditions: 

(5.33) Ji C Ji,i-i. 

(5.34) [j, + i? + (l,0)] n[0,z]2 c J,,,_p ifz>p. 

(5.35) [J,+i?+(l, V+pA)] n[0,i]2 cJ,M-ft. 

(If Pi does not exist, condition (|5.35[) is null.) 
In fact, (|5.33p is equivalent to 

By Lemma 1421 ([5.34p is equivalent to 

= (W^i,i-p)[0,l+i]x[0,i] l[l,l+j]x[0,i]' 

and (|5.35p is equivalent to 

T4^, + (l, V+pA) 

- ^^^'''-l^^\"A^\oA+-i]x[-p^+pt3,,z] \ll,l+i]xl~p^+pf3,-p^+pl3,+t] 

= (^j,i-ft)[0,l+l]x[-p2+p^. \[i i^i]x[_p2_^.pf^. _p2^pp^_^_i] ■ 

Thus ([051) - l[05l) together are equivalent to IV^ < T,. 

Therefore, it remains to show that ([071) and ([051) ^ ([051) - fOSl) . 
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Proof of " ([QT]) and dOS]) ^ (1533]) - ([OS]) " . In dOT]) . letting a = and 5 = 1, 
we obtain 

Hence Ji C Ji.i-i- In a similar way, (|5.34p follows from (|5.27p with a = 1, & = 0; 
(105)) follows from ((OS)) with a = 0, 6 = A. 

Proo/ of "do?]) and (jOS)) ^ (jOg)) - ([QS]) " . First assume i < p. In this case, 
the partial order ~< in [0, i]"^ is the cartesian product of linear orders. Recall that 
(|5.27p and (|5.28p together are equivalent to (|5.5p and note that (|5.5p is equivalent 
to 

i-l 

(J. X {*} + A) n [0, i - if c U ( X {j}). 

3=0 

Thus it suffices to show that 

(5.36) J, n[0,i- 1]^ C J,;j for all < j < i. 

Since Uj^oC'^'J ^ ij}) ideal of [0, i — l]'^, we have Jij C Jij~i for all < j < i. 
By we also have n [0, z - 1]^ c J,,j-i. Hence holds. 

Now assume i > p. Since U}=o('^ij' ^ {j}) ideal of [0, i — 1]^, by Lemma HTTl 
(i), we have 



f [Aj + D + (a, 0)] n [0, z - 1]2 c Aj^ap-b 

\ [J,;j + L> + (a + 1, -p2 + bp)] n [0, i - 1]2 C Aj^ap-b 

for a>0, 0<fe<p— 1 and ap + b < j < i. By Lemma 15.51 we have 



(5.37) 



[Aj +D+{a, 0)] n [0, i]^ C Aj-ap-b 

[Aj + L» + (a + 1, -p2 + fep)] n [0, C Aj-ap-b 



for a>0, 0<fe<p— 1 and ap + b < j < i. Note that /3i is also the largest integer 
such that 1 < /3j < p - 1, i - /3, > and Ji,,_^. ^ [0,^]^. By (jOi)) . (|07)) 
and the proof of Theorem 14.61 we have 

(5.38) 



[J^+D+ (a, 0)] n [0, i]^ C A^-ap-b 

[J, + £» + (a + 1, -p2 + 6p)] n [0, i]^ C .h-ap-b 



for a > 0, < 6 < p - 1 and ap + 6 < j < i. Conditions ((5?27)l and ((5?28l) 
immediately follow form (|5.38p . □ 



Remark. In Lemma 15.61 we always have 

S, < T,. 

In fact, by Lemma [2.11 (i), there is at least one Ji satisfying all the conditions in 
Lemma lOl Thus there exists at least one walk Wi in [0, if such that Si <Wi <Ti. 

Definition 5.7. Let < i < n and let Ji be an ideal of [0, i]^. We call Ji of 
type I if J, n ([i - X [0,«]) = 0; 

type II if J, n {[i -l,i]x [0,«]) ^ but J, n {{i} x [0,i]) = 0; 
type HI a J,n {{i} X [0,i]) ^9. 
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Theorem 5.8. Let 1 < i < n and let Jj (0 < j < i) be an ideal [0,j]^. Assume 
that Jo, . . . , Ji-i is a consistent sequence of ideals and write 

U [(J, X {j}) U (J, X {j})^ U (J, X = y {A, X {j}), 

where Ji j is an ideal of [0, i — 1]^. Let Wi,j — uj{Jij) (0 < j < i) and Wi = w{Ji) 
and let Si and be as in Lemma 1 5. 61 

(i) Ji is of type I and consistent with Jq, . . . , Ji-i if and only if 

(5.39) {0,i)it{Si), (i - 1,0) iL{S^) 
and 

S^<W,< Ti 

where 

Ai is the highest walk in [0, i]^ starting from (0, z — 1) and Bi is the highest 
walk in [0,z]^ ending at {i — 2,0). 

(ii) Ji is of type II and consistent with Jq, . . . , Ji-i if and only if 

(5.40) {0,l)iL{S^), {i,Q)ii{S^) 

and 

I x[o,j] ((« - l,f), {i - 1,0)) 

\Ti< Wi|[o,i_i]x[0,i] < 

for some integer v satisfying 

rO<w<min{p2,2_ii + i} 

(5.41) l{t^l,v)e L{Ti), {i-l,v + i)i i{X,) 
y{v,i ~p) i{Ti) ifi>p 

and for the walks Ti and Ai defined as follows. 

— (<S'i V i?,;^^)|[o^i_i]x[0,i] Ci^v, 
Ai = (Ti A ^i)|[o,i-l]x[0,i] A,?;, 

where Ci^y is the lowest walk in [0, i — 1] x [0, i] ending at {i — l,v), Di^y is 
the highest walk in [0, i — 1] x [0,i] ending at {i — l,v), and 

the lowest walk in [0, i]'^ passing through {v,i —p), if i >p, 
0, ifi<P- 

(iii) Ji is of type III and consistent with Jo, ... , Ji-i if and only if 

$ , <W^< * , 
for some integer u satisfying 

{0 <u<i 
{i,u) e t(T,), {u,i) e i{T,) 
{i,u+l) i l{S,), iu + l,i) i l{S,) 
and for the walks $i and defined as follows. 

^S*, Vi^,,„VM,,„, 



38 



XIANG-DONG HOU 



where Fi^u is the lowest walk in [0, z]^ starting from {u,i), Gi^u is the highest 
walk in [0, z]^ starting from {u,i), Afi.„ is the lowest walk in [0,i]^ ending 
at (i,u), Ni^u is the highest walk in [0, i]^ ending at {i,u). 

Proof. Necessity. We first show the necessity in cases (i) - (iii). By Lenima l5.6[ we 
have Si<Wi<Ti. 

(i) Since is of type I, (i - 1,0) ^ J^. By (0, i) ^ J^. Thus (0, i) ^ t(5,), 
(i -1,0)^ l{S.i) and W^, < A, A B^. Hence < 

(ii) Since Ji is of type II, we have 

W^«l[»-i,i]x[o,j] = ((i - l,-!^), (« - 1,0)) 

for some Q < v < i. Since (i,0) ^ Ji, by ([O]) . (0,i) ^ J^. Thus (i - l,w) G Ji 
imphes that v < and w + (i — 1)^ < i, i.e., 

■ r 2 P ^ 1 ■ 1 1 
V < mm\p , 1 H — ^. 

p p 

Clearly, (0, i) ^ i(5,), (i, 0) ^ /,(5,), (« - 1, «) e i(rO and (z - 1, + 1) ^ iiSi). By 
([5J51) . (u, i - p) e Ji C t(T,) if i > p. 

Since Wi|[o,i-i]x[o,i] ends at (i — l,f), we have 

(5.43) C,;,^ < VKi|[o^,_i]x[o,»] < 

Since (0, i) ^ Ji, we have W < Ai. In case i > p, Lemma 15.31 implies (u, i ^ p) G Ji. 
Thus, whether i > p or not, we always have W > Ei^y. It follows that 

(5.44) S,W E,,y<W^<T,AA,. 
Combining (|5.43p and (|5.44p . we get 

r* < W^j|[0,i-l]x[0,i] < Ai. 

(iii) Assume that Wi ends at {i,u). By (|5.4p . Wi starts with {u,i). Thus Fi^u < 
Wi < Gi^u and Mi,„ < Wi < 7Vi,„. It follows that $j < Wi < Condition ([QS]) 
is obvious. 

Sufficiency. For the sufficiency in cases (i) - (iii), we only give the proof for case 
(iii). The proofs for cases (i) and (ii) are similar. 

By Lemmas 15.11 and 15.21 it suffice to show that conditions (|5.4p - (|5.6p and (|5.8p 
are satisfied. Since 

Fi^u V Af,,„ < W, < A iV,,„, 

Wi must start from (m, i) and end at (i, u). Hence (j5.4p holds. Since 5'i < Wi < Ti, 
by Lemma [5^ (|5.5p and (|5.6p follow. Let w = max{?/ : (i — l,y) e Ji}. Then 
V — u <p^. Thus {v,i — p) -< {u + p'^,i — p) ^ (u, i) G Ji. Hence (u, i — p) G Ji and 
consequently, (|5.15p holds. By Lemma [5731 (|5.8p follows. □ 

Lemma 5.9. /n case (i) o/ Theorem \5.8[ condition (|5.39p implies 

(5.45) 5, < T;'. 
/n case (ii), conditions (|5.40p okc? (|5.4ip imply 

(5.46) r, < A,. 
In case (iii), condition (|5.42p implies 

(5.47) < 



ENUMERATION OF AGL(f:, Fp3)-INVAR,IANT EXTENDED CYCLIC CODES 



39 



Remark. Lemma lSTOl assures the existence of Wi in Theorem l5.8l provided condition 
()5.39|) in case (i), or conditions (|5.40l) and (I5.4ip in case (ii), or condition ()5.42|) in 
case (iii) are satisfied. 

Proof of Lemma \5.9l It is obvious that (|5.39p impUes (|5.45[) and that (|5.42p implies 
()5.47|) . We only prove that ([QO]) and (lOT]) imply (106]) . 

We show that each of the walks 5'i|[o,i-i]x[o,i]i -£'i.ii|[o,i-i]x[o.i] and Ci^v is < 
each of the walks Ti|[o,i-i]x[o.i]j ^i|[o.i-i]x[o,i] a-nd Di_y. Most of these relations are 
obvious. The only ones that need proofs are 

(5.48) E, 

[0,1-1] x[0,i] < ^i|[0,i-l]x[0,i]j 

(5.49) -Bi,i;|[0,4-l]x[0,i] < A,-u, 

(5.50) C'i,!! < I [0,1-1] x[0,i]- 

To prove (|5.48p . we may assume i > p. It suffices to show that {0,i) ^ L{Ei,„), 
i.e., i — p -\- -V < i. (See Figure 27(a).) This is true since v < p^ . 

To prove (|5.49p . we may again assume i > p. It suffices to show that i — p < 
V + {i — 1 — f)p^, i.e., V < i — (See Figure 27(b).) This follows from the 

inequality v < + Mn (|5.4fp . 

To prove ([5?5D| . it suffices to have v + ^{i - I) < i. (See Figure 27(c).) This is 
given by (iMll)- □ 




Figure 27. Proofs of (jSlig)) - (1530]) 

Example 5.10. Let p = 3 and m = 9 (n = y(p — 1) = 6). In this example, 
we exhibit a consistent sequence of ideals Jq, . . . ,Je using Theorem 15.81 Figure 28 
gives the boundaries Wi — uj{Ji) (0 < i < 6) and the walks Si and T,; which are 
needed for choosing Wi. The resulting A- invariant ideal of [0, 6]'^, 

I = U [{J^ X {]}) U {J^ X {j})^ U (J, X {j})^^" , 

1=0 

is depicted in Figure 30. The cross sections of / on the parallels of the xy- 
planes, i.e., Jg.o, ■ • ■ , '/6,5j ^^e ai'e given in Figure 29 in terms of their boundaries 
W6,o, ■ • ■ , W^6,5 7 Wq. The A-symmetry of / is clearly visible in Figure 30. However, 
the fact that / is an ideal in {U, is not obvious from Figure 30. 
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Wo 




W2 

S2=0 

T2 = (2,2) 



W3 

S3=0 

T3 = (3,3) 



Si-. 
T4: 



S5: 
T5: 



W5 



S6=0 



We 



Figure 28. Example [ETUI the walks Si, Ti and Wi 
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We,o We,i We, 2 We, 3 



We,4 We, 5 We 



Figure 29. Example 15.101 boundaries of the cross sections of / 



6 




Figure 30. Example l5.101 the A-invariant ideal / 
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